The sparsity of LASSO-type minimizers

نویسندگان

چکیده

This note extends an attribute of the LASSO procedure to a whole class related procedures, including square-root LASSO, square LAD-LASSO, and instance generalized LASSO. Namely, under assumption that input matrix satisfies ℓ p -restricted isometry property (which in some sense is weaker than standard 2 assumption), it shown if vector comes from exact measurement sparse vector, then minimizer any such LASSO-type has sparsity comparable measured vector. The result remains valid presence moderate error when regularization parameter not too small.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Sparsity and the Lasso Statistical

1.1 A bit of background • If `2 was the norm of the 20th century, then `1 is the norm of the 21st century ... OK, maybe that statement is a bit dramatic, but at least so far, there’s been a frenzy of research involving the `1 norm and its sparsity-inducing properties. Why? Where did this come from? • In short, the `1 norm provides a computationally attractive, theoretically well-justified form ...

متن کامل

The Trimmed Lasso: Sparsity and Robustness

Nonconvex penalty methods for sparse modeling in linear regression have been a topic of fervent interest in recent years. Herein, we study a family of nonconvex penalty functions that we call the trimmed Lasso and that offers exact control over the desired level of sparsity of estimators. We analyze its structural properties and in doing so show the following: 1. Drawing parallels between robus...

متن کامل

Sparsity oracle inequalities for the Lasso

This paper studies oracle properties of !1-penalized least squares in nonparametric regression setting with random design. We show that the penalized least squares estimator satisfies sparsity oracle inequalities, i.e., bounds in terms of the number of non-zero components of the oracle vector. The results are valid even when the dimension of the model is (much) larger than the sample size and t...

متن کامل

Sparsity and smoothness via the fused lasso

The lasso penalizes a least squares regression by the sum of the absolute values (L1-norm) of the coefficients. The form of this penalty encourages sparse solutions (with many coefficients equal to 0).We propose the ‘fused lasso’, a generalization that is designed for problems with features that can be ordered in some meaningful way. The fused lasso penalizes the L1-norm of both the coefficient...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Applied and Computational Harmonic Analysis

سال: 2023

ISSN: ['1096-603X', '1063-5203']

DOI: https://doi.org/10.1016/j.acha.2022.10.004